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Construction  professionals  have  identified  public  contract  law  and  bureaucratic  procurement/contract  offices  as  a  source  of 
problems  in  the  construction  industry.  The  culture  within  the  United  State’s  Federal  Government  Acquisitions  is  based  on  the 
Federal  Acquisition  Regulations  (FARs)  and  its  interpretation,  often  placing  organizations/agencies  in  the  price-based  environment 
and  continuously  resulting  in  poor  performance.  The  United  States  Army  Medical  Command  (MEDCOM)  (approximately 
$100  M  in  construction  renovation  awards  per  year)  attempted  to  overcome  this  obstacle  through  a  partnership  with  the 
Performance-Based  Studies  Research  Group  (PBSRG)  at  Arizona  State  University.  The  MEDCOM  implemented  the  information 
environment  portion  of  the  Performance  Information  Procurement  System  (PIPS)  into  Indefinite  Delivery  Indefinite  Quantity 
(IDIQ)  contracts  through  the  specifications.  Without  controlling  the  various  contract/procurement  processes,  the  developed 
information  environment  stimulated  an  atmosphere  of  accountability  to  all  parties  involved,  while  reducing  the  client’s  internal 
bureaucratic  resistance.  The  concept  has  met  with  preliminary  success,  minimizing  construction  management  issues  by  over  50%, 
raising  owner  satisfaction  by  9%,  resulting  in  99%  of  projects  ending  with  no  contractor-generated  change  orders,  and  assisting 
MEDCOM  leadership  in  measuring  the  performance  of  their  infrastructure  revitalization  program. 

Copyright  ©  2009  Kenneth  T.  Sullivan  et  al.  This  is  an  open  access  article  distributed  under  the  Creative  Commons  Attribution 
License,  which  permits  unrestricted  use,  distribution,  and  reproduction  in  any  medium,  provided  the  original  work  is  properly 
cited. 


1.  Introduction 

The  US  Army  Medical  Command  (MEDCOM)  uses  the 
Corps  of  Engineers  (COEs)  contracting/procurement  offices 
to  deliver  approximately  $100M  of  construction  per  year 
(maintenance,  repair,  and  modification).  The  MEDCOM 
was  introduced  to  the  Performance  Information  Procure¬ 
ment  System  (PIPS)  research,  a  best  value  approach  to 
construction  procurement,  supported  by  the  Performance 
Based  Studies  Research  Group  (PBSRG)  at  Arizona  State 
University  (ASU).  The  MEDCOM  identified  their  orga¬ 
nization  and  environment  as  a  price-based  environment 
producing  low-performance  results  and  characteristics.  They 
were  attracted  to  the  extensive  testing  and  documentation  of 
the  PBSRG  that  supported  the  idea  that  theoretical  concepts, 
processes,  and  structures  based  on  leadership  principles 
(accountability,  alignment,  performance  measurement,  and 
value  based),  rather  than  management  principles  (control, 


direction,  no  performance  measurements,  and  price  based), 
would  optimize  the  delivery  of  construction  (Kashiwagi  et  al. 
[1])  as  well  as  the  recognized  bureaucracy  of  the  COE 
(Wilson  [2]). 

This  paper  focuses  on  identifying  the  differences  between 
the  price-based  and  value-based  environments,  the  imple¬ 
mentation  of  best  value  concepts  by  MEDCOM,  the  results  of 
the  implementation,  and  the  potential  of  information  envi¬ 
ronments  in  the  delivery  of  construction  and  organizational 
efficiency.  In  the  research,  no  procurement  is  performed; 
only  the  application  of  an  information  environment  and  the 
culture  transformations  required  is  addressed. 

2.  Differential  between  the  Price-Based 
and  Value-Based  Environments 

The  difference  between  the  price-based  and  value-based 
environments  is  illustrated  in  the  Construction  Industry 
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Figure  1:  Construction  industry  structure  (CIS)  (Kashiwagi  [4]). 


the  use  of  expertise,  asking  the  contractor/vendor  to  price 
only  what  is  written,  ignoring  the  owner’s  intent.  It  also 
motivates  contractors  to  take  the  lowest  price  at  the  last 
minute,  not  knowing  whether  they  are  meeting  the  specifi¬ 
cations.  Additionally,  the  price-based  approach  encourages 
all  manufactures  to  ensure  that  their  products  meet  only 
the  lowest  possible  quality  to  get  the  largest  possible  volume 
sales  of  contractors  trying  to  get  the  lowest  price.  On  an 
industry  level,  the  price-based  approach  promotes  the  bypass 
of  education  and  personnel  training,  leading  to  a  critical 
shortage  of  trained  personnel.  This  results  in  the  contractor 
relying  on  the  client  to  manage,  direct,  control,  and  inspect, 
and  become  reactive  instead  of  proactive.  Overall,  it  leads  to 
poor  construction  performance  (not  on  time,  not  on  budget, 
and  not  meeting  the  client’s  expectations). 
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Figure  2:  Impact  of  price-based  bidding:  increase  of  risk  (Kashiwagi 
[4]). 


Structure  (CIS)  diagram  (Figure  1).  The  best  value  envi¬ 
ronment  focuses  on  securing  the  best  value  vendor  for 
the  owner  by  considering  the  vendor’s  past  performance, 
ability  to  identify  and  minimize  risk,  preplanning  foresight, 
and  project  knowledge.  It  transfers  all  project  risk  to  the 
outsourced  expert,  requiring  the  contractor  to  use  their  skill 
to  fulfill  the  intent  of  the  owner,  and  minimizes  controlled 
risk  at  the  beginning  of  the  project.  It  forces  accountability 
between  all  parties  and  benefits  vendors  with  foresight, 
experience,  skill,  and  efficiency.  It  provides  an  environment 
that  maximizes  contractor  profit,  while  minimizing  owner 
resources  (Guo  [3]). 

In  contrast,  the  price-based  environment  focuses  on 
using  minimum  standards  to  define  the  requirement  of  the 
contract,  in  order  to  ensure  that  the  minimal  requirement 
is  met.  Due  to  its  concentration  on  price,  it  encourages  the 
contractors  and  vendors  to  translate  the  minimum  require¬ 
ment  to  a  maximum,  in  attempts  to  lower  the  quality  of 
the  delivered  product  to  gain  the  competitive  advantage.  The 
price-based  environment  gives  inexperienced  contractors  the 
competitive  advantage  over  experienced  contractors,  thus 
driving  the  experienced  contractors  to  move  from  a  position 
of  minimizing  risk  to  a  position  of  ignoring  project  risk  (PSC 
2003,  Statistics,  Trends,  Market,  Analysis  2003). 

This  trend,  which  is  clearly  demonstrated  in  Figure  2, 
has  many  ramifications.  The  price-based  approach  penalizes 
contractors  who  carefully  preplan,  understand  the  scope 
of  the  project,  and  price  out  the  project.  This  discourages 


2.1.  Relative  Analysis  of  the  Two  Environments.  A  relative 
analysis  of  the  two  environments  (price-based  and  best 
value)  leads  to  the  following  deductive  conclusions.  Per¬ 
formance  can  only  occur  when  risk  is  transferred  to  an 
entity  that  has  the  capabilities  of  minimizing  the  risk.  The 
best  value  environment  ensures  the  selection  of  a  qualified 
contractor  through  the  use  of  performance  information 
filters.  The  majority  of  the  owner’s  resulting  risk  in  this 
environment  is  the  interface  or  the  seam  between  the  client 
and  the  contractor,  or  in  other  words  the  risk  that  the 
contractor  does  not  directly  control  (See  Figure  3). 

Alternatively,  the  price  based  environment  passes  risk 
to  the  contractor  with  the  lowest  price,  without  ensuring 
that  they  can  minimize  the  risk.  When  risk  is  transferred 
to  a  party  unable  to  minimize  the  risk,  the  party  must  be 
managed,  inspected,  and  controlled.  In  consequence,  the 
owner’s  risk  in  the  low-price  environment  is  the  potential 
that  the  minimally  trained,  managed,  and  directed  contrac¬ 
tor/vendor  may  not  do  what  they  are  directed  to  do  (see 
Figure  3).  The  price-based  environment  has  reflected  this,  in 
a  heavy  overhead  for  transaction  costs  relating  to  manage¬ 
ment,  direction,  control,  inspection,  and  communications 
that  would  be  eliminated  if  the  client’s  process  were  more 
efficient.  This  has  also  translated  to  a  higher  requirement  of 
people  needed  to  maintain  the  system  (due  to  inefficiency  of 
the  process). 

Accordingly,  there  is  more  confusion  in  the  price-based 
environment  due  to  the  management,  decision  making, 
unrealistic  expectations,  attempts  to  control  others,  use 
of  leverage  (making  a  party  do  free  work  or  work  that 
they  are  incapable  of  doing),  and  the  lack  of  performance 
information  of  key  individuals,  contractors,  and  the  client’s 
personnel.  Without  simple,  easy-to-understand  measure¬ 
ments,  that  consider  the  vendor’s  capabilities,  the  price-based 
environment  remains  adversarial,  where  every  participant, 
regardless  of  who  they  work  for,  protects  themselves,  before 
they  protect  the  company  they  work  for,  or  the  client/user 
the  construction  is  being  built.  These  characteristics  are 
supported  by  documentation  of  construction  delivered  by 
the  price-based  environment  (Butler  [5];  Doree  [6];  Fitz- 
Gibbon  and  Golding  [7];  Guo  [3];  Markus  [8];  NDU  [9]; 
Post  [10];  [11]). 
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Figure  3:  Difference  in  risk  between  price-based  and  best-value  environments. 


3.  Best  Value  Performance  Information 
Procurement  System 

Over  the  past  thirteen  years,  PBSRG  has  been  testing  best 
value  procurement  using  an  information-based  Performance 
Information  Procurement  System  (PIPS)  in  both  the  public 
and  private  sector.  The  results  and  measurements  of  PIPS 
have  validated  the  best  value  concepts.  Of  the  480  tests 
completed  and  $500  M  of  procured  construction,  98  percent 
of  projects  finished  on  time,  on  budget,  while  meeting  client 
expectations.  The  process  has  minimized  the  management 
efforts  of  client  construction  managers  by  80  to  90  percent 
(Kashiwagi  et  al.  [12],  Sullivan  et  al.  [13])  and  allowed  the 
project  managers  to  increase  their  delivery  of  projects  by  up 
to  tenfold  (State  of  Hawaii  [11]).  The  process  was  awarded 
the  2005  Corenet  Global  Innovation  of  the  Year  Award  for 
testing  at  Harvard  University  and  the  2000  Tech  Pono  Award 
for  the  testing  at  the  State  of  Hawaii. 

3.1.  Best  Value  PIPS  Process.  The  Best  Value  PIPS  process 
(shown  in  Figure  4)  is  composed  of  three  primary  steps: 

(1)  selection  phase  (Filter  1-4):  identification  of  the  best 
value 

(2)  preplanning/quality  control  phase  (Filter  5):  forcing 
the  best  value  to  preplan  and  minimize  risk  that  they 
control  and  do  not  directly  control  through  a  PIPS 
Quality  Control  Plan  or  Risk  Plan  and  schedule, 

(3)  risk  management  phase  (Filter  6):  management  of  the 
construction  project  through  risk  minimization. 

Selection  Phase.  The  selection  phase  attempts  to  differentiate 
the  performance  and  expertise  of  competing  vendors.  This 
is  done  through  the  collection  of  each  contractor’s  past 
performance  information  (from  key  individuals  as  well  as 
the  general  contractor  and  critical  subcontractors),  identifi¬ 


cation  of  project  risk  out  of  their  control,  plans  to  minimize 
uncontrolled  risks,  value-added  options,  and  interview  rat¬ 
ings.  It  is  important  to  note  that  if  the  contractors  cannot 
differentiate  themselves  through  their  performance,  there 
is  nothing  wrong  with  awarding  the  project  based  on  the 
best  price  (as  the  contractors  proved  that  they  are  all  the 
same).  The  client  should  not  make  decisions  to  assist  any 
contractor  to  become  competitive.  No  contractor  should  be 
assisted  by  being  given  a  second  chance,  redoing  their  cost 
estimate,  or  given  information  from  other  contractors  that 
could  possibly  make  them  more  competitive.  In  best  value, 
every  contractor  is  competitive,  and  every  contractor  has  a 
chance  to  differentiate  themselves  without  biased  assistance 
from  the  client’s  representative. 

Preplanning/Quality  Control  Phase.  The  Best  Value  PIPS 
process  forces  the  “best  value”  contractor  to  take  their  price, 
risk  assessment/value-added  plan,  and  interview  statements 
into  the  second  phase  of  Preplanning/Quality  Control.  In 
the  preplanning/PIPS  Quality  Control  Phase,  the  contractor 
concentrates  on  minimizing  the  project  risks.  A  schedule 
listing  the  major  milestones  in  the  project  is  developed,  along 
with  a  list  of  client  action  items,  or  a  list  of  tasks,  decisions, 
and  so  forth  needed  from  the  client  (with  dates).  A  QC  plan  is 
also  compiled  by  the  contractor  which  includes  a  list  of  risks 
out  of  the  contractor’s  immediate  control  in  conjunction 
with  a  detailed  plan  to  minimize  each  risk.  Technical  risks 
are  not  included,  as  the  contractor  minimizes  risks  that  they 
control  by  meeting  the  requirements  of  the  specification. 
After  the  owner  has  evaluated  the  contractor’s  uncontrollable 
risks;  agreed  to  the  accompanying  plans  to  mitigate  the 
risks;  had  his  risk  and  concerns,  as  given  to  the  contractor, 
addressed  and  mitigated  with  risk  minimization  plans;  has 
agreed  to  the  dates  and  client  action  item  requirements;  and 
in  total  is  satisfied  with  the  preplanning  performed  by  the 
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Figure  4:  Best  value  natural  selection  (Kashiwagi  [4]). 


contractor,  will  the  contract  be  awarded?  If  the  client  is  not 
satisfied,  the  client  can  move  the  next  highest  rated  vendor. 

In  having  the  “best  value”  contractor  create  a  QC  plan, 
the  authors  are  making  the  assumption  that  it  is  much  easier 
to  have  the  contractor  identify  risks  to  the  project  that  they 
do  not  control,  than  it  is  to  identify  all  the  risks  that  the 
contractor  does  control.  It  also  transfers  the  risk  to  the 
contractor  by  having  the  contractor  identify  the  risks.  The 
authors  are  also  assuming  that  a  nonexperienced  contractor 
will  not  feel  comfortable  managing  the  risk  in  this  situation, 
due  to  their  inability  to  efficiently  identify  the  risks  that  they 
do  not  control.  This  is  because 

(1)  experienced  contractors  know  the  roles  and  impact 
of  different  participants  (Anvuur  and  Kumaraswamy 
[14]), 

(2)  inexperienced  contractors  are  reactive,  and  only 
know  their  risk  in  terms  of  what  they  are  supposed 
to  do  (Zack  [15]), 

(3)  experienced  contractors  do  not  need  to  be  managed 
and  directed  (Buckshon  [16]). 

Risk  Management  Phase.  Once  the  project  has  been  ini¬ 
tialized,  the  contractor  enters  the  Risk  Management  Phase. 
Every  week  during  project  execution,  the  contractor  is 
required  to  submit  a  Quality  Assurance  (QA)  plan  and 
Weekly  Report  to  the  owner.  The  QA  plan  is  a  checklist  of 
the  risks  identified  in  the  previous  phase  that  ensures  that 
each  risk  is  being  monitored  and  minimized  according  to 
the  directives  included  in  the  QC  plan.  If  the  risk  cannot  be 
minimized  according  to  client-preapproved  QC  efforts,  the 
risk  is  reported  on  the  weekly  report  along  with  unforeseen 
risks  adversely  impacting  the  schedule  or  budget.  The  weekly 
report  identifiesthe  following:  ( 1 )  why  the  contractor  was  not 
able  to  minimize  the  risk;  (2)  what  or  who  is  the  source  of  the 
risk;  (3)  what  needs  to  be  done  by  the  source  of  the  risk  to 
minimize  the  risk;  and  (4)  what  the  impact  to  the  project  will 
be  in  terms  of  time,  cost,  and  expectation.  If  the  contractor 


Unforeseen  risks 


Figure  5:  Information  environment. 


has  done  all  that  they  can  to  minimize  the  risk,  the  client  is 
then  obliged  to  pay  for  additional  time  and  effort.  Figure  5 
shows  the  QC  Plan,  components,  the  QA  checklist  as  derived 
from  the  QC  Plan  and  the  flow  of  risk  identification  to  the 
weekly  risk  report.  From  the  weekly  risk  report  information, 
the  system  can  generate  a  director’s  report  that  gives  the 
performance  of  the  project  and  various  system  participants. 

The  preplanning,  quality  control,  and  measurement 
process  transfer  the  control  and  risk  to  the  contractor,  who 
then  uses  the  mechanism  of  the  weekly  report  to  make  all 
parties  accountable  through  communication,  coordination, 
and  additional  preplanning.  It  is  by  contract,  and  in  the  best 
interest  of  the  contractor,  to  report  the  risks  on  the  weekly 
report.  The  QC  plan,  QA  checklist,  and  weekly  report  are  all 
documents  that  identify  the  risks  that  the  contractor  does  not 
control,  protecting  the  performing  contractor. 

The  selection  process  ensures  the  procurement  of  the 
best  value  contractor  and  the  transfer  of  all  project  risk  to 
the  contractor.  The  QC  plan  and  the  weekly  risk  report 
then  defend  the  high  performing  contractor  by  identifying 
risks  out  of  the  contractor’s  control  and  the  contractor’s 
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Figure  6:  Best  value  DMAIC  closed  loop  (Kashiwagi  [4] ). 

limited  abilities  to  impact  the  risk.  Because  it  is  reviewed 
by  the  client’s  representative,  the  information  is  usually  very 
accurate.  The  QC  plan,  QA  checklist,  weekly  report,  and 
schedule  also  help  to  regulate  the  contractor’s  work.  All 
the  elements  are  incorporated  into  the  contractor’s  contract 
upon  award.  At  the  end  of  the  project,  the  contractor  is  rated 
by  the  owner,  and  the  rating  modifies  the  past  performance 
rating  of  the  contractor  by  50%  (Figure  6). 

Information  System.  The  owner  is  able  to  compile  a  group  of 
individual  contractor  weekly  reports  (spreadsheets  submi¬ 
tted  to  the  client  weekly)  into  a  Director’s  Report  (Table  1 ) 
which  can  give  a  Facility/Construction  director  valuable 
measurements  of  risk/performance  for  the  organization  as  a 
whole  as  well  as  a  prioritization  of  the  risks.  The  Director’s 
Report  also  allows  for  the  comparison  of  contractors, 
project  managers,  project  integrators,  inspectors,  or  design 
professionals  involved  in  the  projects.  The  report  provides 
accurate,  timely  risk/performance  information  that  disables 
bureaucracy  and  identifies  where  risk  is  being  created.  For 
the  first  time,  it  gives  a  director  a  simplistic  information  sys¬ 
tem  with  minimal  maintenance  that  deters  nonperformance 
by  highlighting  nonperformance  quickly  and  accurately. 

In  the  report,  the  majority  of  the  information  itself  is 
a  simple  sum  or  average  of  the  data  from  the  weekly  risk 
reports  (one  is  submitted  for  each  project  each  week). 
The  only  algorithmic-based  information  is  the  risk  number, 
which  is  simply  computed  as 

Risk  Number 

=  (11  -  Project  Satisfaction  Rating) 

*  (l  +  %  over  budget)  *  (1  +  %  over  schedule). 

(1) 


4.  Proposing  Best  Value  to  the  COE 

MEDCOM  proposed  to  the  COE  that  by  selecting  Indefinite 
Delivery  Indefinite  Quantity  (IDIQ)  contractors  and  award 
task  orders  based  on  the  following  best  value  principles 
and  process,  the  efficiency  and  performance  of  construction 
procurement  could  be  increased.  However,  the  COE  decided 
that  there  were  too  many  changes  and  believed  that  some 
of  the  changes  were  not  legally  allowed  (this  is  a  point  of 
disagreement  between  several  COE  agencies).  Some  of  the 
changes/misunderstandings  included  the  following. 

( 1 )  The  COEs  were  under  the  misunderstanding  that  the 
process  was  proprietary  and  that  Arizona  State  Uni¬ 
versity  (ASU)  would  be  running  their  procurement. 
It  is  illegal  for  the  COE  to  outsource  its  procurement 

[17]. 

(2)  The  COE  felt  that  non-COE  personnel  could  not  be 
on  the  selection  team. 

(3)  The  Army  Federal  Acquisition  Regulation  (AFAR) 
would  not  permit  the  use  of  weights  and  numbers  in 
a  best  value  selection  [17]. 

(4)  The  preaward  phase,  where  the  best  value  contractor 
creates  their  quality  control  (QC)  plan,  quality  assur¬ 
ance  (QA)  checklist,  and  schedule,  was  not  allowed  by 
the  Federal  Acquisition  Regulation  (FAR),  due  to  the 
requirement  to  have  discussions  with  all  the  offerors 
before  the  award  of  the  contract  [17]. 

(5)  The  existing  COE  quality  assurance  plan  was  verifica¬ 
tion  of  the  technical  requirements,  while  the  QC  plan 
for  the  Best  Value  PIPS  was  to  minimize  risk  that  the 
contractor  did  not  control. 

The  above  points  of  resistance  were  either  misunderstand¬ 
ings  or  items  that  could  easily  be  adapted  to  ensure 
regulation  compliance.  The  current  Director  of  the  Facility 
Life  Cycle  Management  Division  at  MEDCOM  realized  that 
the  cultural  change  required  to  implement  Best  Value  PIPS  in 
the  COE  was  too  drastic,  and  he  proposed  to  obtain  higher- 
performance  results  another  way.  With  assistance  from  the 
Performance-Based  Studies  Research  Group,  the  Director  of 
MEDCOM  proposed  to  overcome  the  COE’s  resistance  to 
change  and  policies  by  using  the  theoretical  concepts  of  a 
best  value  environment  as  a  component  of  the  technical 
requirements/specifications  of  the  IDIQ  contract  that  the 
COE  would  award  to  the  IDIQ  contractor.  It  was  also 
proposed  that  the  best  value  environment  and  an  informa¬ 
tion  environment  as  presented  by  Kashiwagi  [4]  were  the 
same,  and  therefore  an  information  environment  required 
in  the  specifications  would  mimic  a  best  value  environment 
without  altering  the  procurement  system.  It  was  further 
hypothesized  that  the  contractors  would  understand  that  an 
information  environment  would  maximize  their  efficiency 
and  profit  and  therefore  be  in  their  own  best  interests.  This 
realization  coupled  with  the  information  environment  would 
increase  the  performance  of  the  IDIQ  contractors. 

The  director  decided  to  create  a  best  value  information 
environment,  embed  within  the  technical  specifications  of 
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Table  1:  Weekly  report  and  director’s  report, 
(a)  Individual  project  performance  from  weekly  report 


Unforeseen  (UF)  &  Owner  (0)  Risk 

#  UF  Risks  affecting  budget/schedule 

Days  delayed  (Calendar) 

Additional  costs 

#  0.  Risk  affecting  budget/schedule 

Days  delayed  (Calendar) 

Additional  costs 

0 

0 

0 

1 

0 

$2,000.00 

Above  risks  include  potential  and  resolved 

Contractor  risks 

#  of  Unaddressed/ Overdue  Risks 

1 

#  Unrated  risks 

0 

#  Risks  affecting  budget/schedule 

2 

Risks  to  schedule  (calendar  days) 

15 

Risk  to  cost 

$1,000.00 

Contractor  satisfaction  rating 

10 

Above  risks  include  potential  and  resolved 

Overall  current  status 

Days  delayed  (calendar  days) 

5 

%  Delayed 

0.8% 

Contractor  %  delayed 

0.8% 

Additional  costs 

$2,000.00 

%  Over  award 

9.2% 

Contractor  %  over  award 

0% 

Project  satisfaction  rating 

10 

Risk  number 

1.16 

Above  schedule  and  budget  additions  include  only  resolved  risks 

(b)  Overall  organization  performance 

Division  overview 

25/9/2009 

Original  projects  budget 

$585  999  296.63 

Current  estimated  cost 

$613  872  042.82 

Estimated  cost  over  budget 

$27  872  746.19 

Project  overview 

Total  number  of  projects 

194 

%  projects  on  time 

43% 

Number  of  jobs  delayed 

111 

%  projects  on  budget 

54% 

Number  of  jobs  over  awarded  budget 

16 

Number  of  projects  missing  owner  ratings 

0 

Average  project 

Project  schedule  length  in  days 

Project  budget 

$3  020  614.93 

%  over  awarded  budget 

4.76% 

%  over  budget  due  to  owner 

3.42% 

%  over  budget  due  to  contractor 

0.03% 

%  over  budget  due  to  unforeseen 

1.31% 

Average  length  of  project 

529 

%  Delayed 

24.07% 

%  Delayed  due  to  owner 

17.21% 

%  Delayed  due  to  contractor 

1.89% 

%  Delayed  due  to  unforeseen 

4.97% 
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(b)  Continued. 


Division  overview 

25/9/2009 

Number  of  risks 

2.00 

Number  owner  generated  risks 

1.36 

Number  of  overdue  risks 

0.52 

Owner  rating 

9.36 

Risk  number 

2.86 

(c)  Risk  ranking  in  projects 

Top  10  risk  ranking  projects  9/25/2009 

Number 

Project 

Risk  number 

1 

Addition  to  Third  Floor  Womans  Health  Care  Suite 

42.63 

2 

Replace  Hot  Water  Converters 

28.98 

3 

Construct  Rollup  Connections  for  Boilers  &  Chillers 

28.09 

4 

Security  Repairs 

18.22 

5 

Misc.  Medical  Repair  Projects  ’08 

13.10 

6 

Rep,  Reconf  for  TBI  Program 

12.73 

7 

Bathroom  Conversions,  Bldg  9200 

12.66 

8 

Renew  Health  Clinic,  Building  990 

11.01 

9 

Repair  AHU  Number  2  and  Number  3 

10.73 

10 

Renew  Smith  Dental  Clinic 

8.04 

(d)  Comparing  vendor  performance 

Contractor  overview 

Contractor  A  Contractor  B 

Contractor  C 

Total  awarded  budget 

$1202  511 

$474170 

$4  015  198 

Current  cost 

$4  907  721 

$487  924 

$4  357  671 

Over  budget 

$3  705  210 

$13  754 

$342  473 

Project  overview 

Total  number  of  projects 

1 

1 

1 

%  Projects  on  time 

0% 

0% 

0% 

Number  of  Jobs  delayed 

1 

1 

1 

%  Projects  on  budget 

0% 

0% 

0% 

Number  of  Jobs  over  awarded  budget 

1 

1 

1 

Average  project 

Number  of  Risks  per  job 

3.00 

3.00 

5.00 

Owner  generated  risks 

0.00 

3.00 

5.00 

Number  of  overdue  risks 

1 

0 

1 

%  Over  awarded  budget 

308.12% 

2.90% 

8.53% 

%  over  budget  due  to  owner 

0.00% 

2.90% 

8.53% 

%  over  budget  due  to  contractor 

0.00% 

0.00% 

0.00% 

%  over  budget  due  to  unforseen 

308.12% 

0.00% 

0.00% 

Number  of  Days  delayed 

601 

99 

183 

Number  of  days  delayed  due  to  owner 

0 

99 

183 

Number  days  delayed  due  to  contractor 

0 

0 

0 

Number  days  delayed  due  to  unforseen 

601 

0 

0 

Owner  rating 

10.00 

6.71 

6.63 

Risk  number 

13.10 

6.16 

6.09 

MEDCOM,  and  then  measure  the  results.  Through  measure¬ 
ment,  accountability  would  be  realized  and  the  information 
environment  would  in  essence  encourage  the  contractors 
to  improve  and  perform.  The  environment  would  make 


every  participant  accountable  as  all  would  be  measured 
(contractors,  MEDCOM  personnel,  COE  personnel,  etc.). 
Performance-based  specifications  have  been  proposed  before 
[18];  however,  simultaneously  using  specifications  with 
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minimum  standards,  best  value  concepts,  and  an  informa¬ 
tion  environment  is  a  new  contribution  to  the  delivery  of 
construction. 

This  hypothesis  makes  one  of  the  following  assumptions. 

(1)  A  lower  performing  contractor  can  become  a  high 
performer  by  using  a  best  value/information  struc¬ 
ture. 

(2)  A  contractor  who  competes  on  a  specification  that 
requires  them  to  report  the  delivering  of  construc¬ 
tion  through  a  best  value/information  environment 
structure  will  educate/train  their  personnel  to  act  in 
a  manner  to  deliver  performing  results. 

(3)  An  information  environment  forces  accountability 
regardless  of  the  selection  process. 

5.  Implementing  Best  Value  PIPS  through 
Specification 

The  Best  Value  PIPS  process  is  flexible  and  can  be  adjusted 
for  implementation  on  Design-Build,  CM@Risk,  Design- 
Bid-Build,  IDIQ  contracts,  or  on  designers  (Kashiwagi 

[4]).  In  order  to  implement  Best  Value  PIPS  into  the  US 
Medical  Command  (MEDCOM),  the  system  was  adjusted 
in  order  to  assure  compatibility  with  the  FAR  and  the  AFAR 
Supplement. 

The  term  “best  value”  is  mentioned  34  times,  and  the 
term  “low  bid”  is  mentioned  19  times  in  the  FAR.  Best  Value 
means  the  “expected  outcome  of  an  acquisition  that,  in  the 
estimation  of  the  Government,  provides  the  greatest  possible 
benefit  to  the  requirement  (FAR  2.1).”  The  benefits  include 
(FAR  102.2(b))  the  following  to 

(1)  satisfy  the  customer  in  terms  of  cost,  quality,  and 
timeliness  of  the  delivered  product  or  service  by,  for 
example, 

(i)  maximizing  the  use  of  commercial  products 
and  services, 

(ii)  using  contractors  who  have  a  track  record  of 
successful  past  performance  or  who  demon¬ 
strate  a  current  superior  ability  to  perform, 

(iii)  promoting  competition; 

(2)  minimize  administrative  operating  costs; 

(3)  conduct  business  with  integrity,  fairness,  and  open¬ 
ness. 

The  intent  of  the  Federal  Acquisition  Regulation  [17]  is 
to  use  a  method  that  will  bring  the  government  the  “best 
value,”  whether  or  not  the  strategy  has  been  addressed  by 
the  government.  It  explicitly  states  that  “Absence  of  direction 
should  be  interpreted  as  permitting  the  Team  to  innovate 
and  use  sound  business  judgment  that  is  otherwise  consistent 
with  law  and  within  the  limits  of  their  authority.”  In  the 
delivery  of  construction,  the  FAR  recommends  sealed  bids. 
However,  in  FAR  36.103b  and  6.04(b)(1),  it  states  that  if  the 
use  of  sealed  bids  cannot  effectively  deliver  the  best  value,  the 


request  for  proposal  process  using  other  criteria  than  price 
can  be  used. 

The  FAR  also  addresses  the  use  of  the  PIPS  filters  of 
past  performance  (FAR  15.305(a)(2)),  the  risk  assessment 
plan/value  added  plan  (FAR  15-305(a)(3)(i)),  and  the  inter¬ 
view  (FAR  15.102).  The  FAR  addresses  prioritization  of 
alternatives  by  stating  that  “An  agency  shall  evaluate  compet¬ 
itive  proposals  and  then  assess  their  relative  qualities  solely 
on  the  factors  and  subfactors  specified  in  the  solicitation. 
Evaluations  may  be  conducted  using  any  rating  method 
or  combination  of  methods  . . .”  However,  the  Army  FAR 
Supplement  states  (5115.304)  that  “Evaluation  Factors  and 
Significant  Subfactors  must  be  qualitative  (i.e.,  adjectival, 
colors,  or  other  indicators,  but  not  numbers).  Numerical 
weighting  is  not  an  authorized  method  of  expressing  the 
relative  importance  of  these  factors  and  subfactors.” 

Therefore,  when  selecting  a  contractor,  AFAR  Supple¬ 
ment  Best  Value  process  must  not  use  either  weight  or 
the  ratings  on  any  of  the  evaluation  factors  must  have 
qualitative  ratings.  The  impact  of  this  policy  is  the  lack  of 
transparency  but  also  prevents  protests  due  to  the  inability 
or  difficulty  to  challenge  a  subjective,  nontransparent  system. 
The  downside  to  this  type  of  system  is  that  it  motivates 
owner  representatives  to  make  decisions  instead  of  allowing 
the  contractors  to  determine  who  gets  the  project  based 
on  a  preset  system  that  is  very  predictable.  However,  Best 
Value  PIPS  can  still  be  run  using  qualitative  ratings  on  past 
performance,  risk  assessment/value  added  submittal,  and 
interviews. 

As  a  result  of  the  FAR  and  AFAR  Supplement,  the 
following  changes  were  made. 

(1)  The  preplanning  quality  control  period  is  performed 
during  a  preconstruction  period  after  the  award  of 
the  contract. 

(2)  The  technical  and  nontechnical  concerns  of  the 
client/user  are  given  to  all  contractors. 

Accordingly,  the  MEDCOM  incorporated  the  following 
into  their  specifications: 

(1)  checklists  that  forced  the  use  of  preplanning  and 
a  quality  control  plan  that  minimized  the  risk 
that  the  contractor  did  not  control;  these  checklists 
applied  to  both  the  design  stage  (work  plan)  and  the 
construction  stage; 

(2)  the  use  of  a  quality  control  plan  (focused  on  risk 
identification  and  minimization),  a  quality  assurance 
checklist,  a  schedule,  and  a  weekly  reporting  system 
tracking  the  risk  that  the  contractor  did  not  control. 

The  MEDCOM  then  used  the  information  system  to 
compile  multiple  weekly  risk  reports  and  develop  current 
performance  barcodes  or  measurements  for  the  entities 
involved.  Performance  measurements  were  computed  for 
thecontractors  (Table  1(d)),  as  well  as  the  COE  project  man¬ 
agers,  the  MEDCOM  project  integrators,  and  the  procure¬ 
ment  offices.  The  numbers  shown  are  the  summary  averages 
from  the  weekly  risk  reports  for  the  individuals  or  offices 
projects. 
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6.  Preliminary  Test  Results 

The  MEDCOM  performance  before  the  test  was  run 
included  the  following. 

(1)  Frequent  problems  are  presented  to  the  MEDCOM 
construction  manager. 

(2)  Fifty  percent  of  the  projects  are  on  time  and  on 
budget. 

(3)  Contractors  on  80  percent  of  the  projects  do  not 
preplan  and  minimize  risk. 

(4)  For  half  of  the  projects  that  are  delayed,  the  reason  for 
the  delay  is  unclear. 

(5)  None  of  the  contractors  had  their  own  QC  plan, 
QA  checklists,  and  weekly  risk  report  that  protected 
themselves  and  the  clients. 

(6)  No  contractors  showed  interest  or  initiative  in  under¬ 
standing  the  best  value  concepts. 

The  information  environment  was  initially  pilot  tested 
on  six  projects  (no  procurement  was  performed,  only  appli¬ 
cation  of  the  information  environment),  and  within  eight 
months  it  was  expanded  to  encompass  87  projects.  In  the  past 
year  it  has  been  implemented  on  all  projects  with  a  budget 
value  greater  than  $300  000  (USD),  which  is  at  the  time  of 
publication,  a  total  of  189  projects  with  a  construction  value 
of  over  $289  000  000  (USD).  The  information  environment 
allowed  the  owner  to  identify  the  source  of  project  risk 
and  change  orders.  It  was  found  that  88%  of  cost  and 
schedule  runs  were  due  to  the  owner,  while  12%  was  due 
to  the  contractor.  Also,  the  current  estimate  of  the  number 
of  projects  with  performance  issues  requiring  high-level 
assistance  is  15  (out  of  189)  or  eight  percent.  Out  of  these 
projects,  only  5  of  them  are  due  to  the  contractor  problems. 

Other  results  include 

(1)  99%  of  projects  currently  on  budget  (no  contractor 
changes  to  budget), 

(2)  average  contractor  budget  increase  is  .03%, 

(3)  95%  of  projects  currently  on  time  (no  contractor 
changes  to  schedule), 

(4)  average  owner  satisfaction  rating  increase  of  9%, 
from  8.99  to  9.80  owner  satisfaction  on  completed 
projects  (1-10  scoring,  10  being  the  highest), 

(5)  average  time  to  resolve  a  project  risk  decreased  by 
54%, 

(6)  the  contractors  began  to  personally  invest  in  the 
education  and  training  of  best  value  procurement, 
introducing  and  encouraging  nongovernment  clients 
to  use  the  PIPS  system. 

The  implementation  of  the  information  environment  in¬ 
creased  overall  owner  satisfaction  ratings  for  each  of  the  five 
contractors  involved  by  up  to  64%.  The  performance  order 
or  ranking  of  the  five  primary  contractors  was  not  affected; 
however  the  overall  contractor  performance  increased  sub¬ 
stantially,  averaging  9%.  Throughout  the  transformation, 


the  contractors  began  focusing  on  the  performance  of  the 
project,  in  terms  of  the  minimization  of  owner  risk,  rather 
than  project  specifications.  This  was  confirmed  through 
contractor  educational  meetings,  newsletters,  interviews,  and 
emails.  An  excerpt  from  one  contractor  newsletter  read  “The 
primary  goal  of  the  PIPS  process  is  to  identify  and  mitigate 
early  on  any  risk/problem  that  may  have  the  potential  to 
keep  the  task  order  from  being  completed  on  time  and  within 
budget ...  It  is  intuitively  obvious  that  we  need  to  seriously 
concentrate  on  improving  the  “service”  that  we  are  providing 
to  the  Government.” 

Once  the  IDIQ  contractors  had  been  educated  in  the  Best 
Value  process,  they  began  to  realize  that  it  would  assist  them 
to  be  more  efficient,  make  the  client’s/user’s  representatives 
accountable,  and  maximize  their  profits  without  charging 
more  (win-win).  The  contractors  began  to  realize  that  the 
process  was  a  very  successful  enterprise  model  that  used  best 
business  practices,  motivated  their  personnel  to  improve, 
and  measured  their  own  performance.  The  majority  of  the 
contractors  began  requesting  their  personal  performance 
measurements. 

The  MEDCOM  organization  also  noted  the  following 
preliminary  results. 

(1)  Projects  started  with  the  best  value  environments 
have  had  no  outstanding  issues  where  the  contractor 
is  at  fault. 

(2)  The  information  system  has  clearly  and  efficiently 
identified  that  the  biggest  source  of  risk  are  the  client 
and  procurement/contracting  offices. 

(3)  There  have  been  no  disagreements  or  argument  over 
the  risk’s  source  or  the  responsible  entity,  once  it  is 
identified  by  the  process. 

(4)  Contractors  are  slowly  learning  the  process  of  mini¬ 
mizing  risk  that  they  do  not  control. 

(5)  The  submission  of  meaningful  contractor  quality 
control  plans  has  been  a  challenge. 

(6)  The  contractors  and  users  have  had  a  difficult  time 
understanding  the  connection  and  use  of  the  QC 
plan,  QA  checklist,  and  the  weekly  report. 

6.1.  Resistance  to  Change.  The  migration  to  Best  Value  is 
threatening  to  the  status  quo  due  to  the  following. 

(1)  Best  Value/PIPS  forces  the  government  to  release 
control  to  the  outsourced  vendor.  It  is  difficult  for 
procurement  agents  to  release  control. 

(2)  Increased  efficiency  threatens  the  procurement  com¬ 
munity,  who  may  feel  that  their  jobs  are  being 
replaced  or  eliminated. 

(3)  Cultural  change  often  is  accompanied  by  fear,  man¬ 
ifested  in  resistance  to  change,  not  being  open 
to  logic/best  practices,  using  the  FAR  and  AFARS 
and  interpreting  new  concepts  as  illegal,  increasing 
transaction  costs  of  other  participants  in  the  delivery 
chain,  and  not  acting  in  the  best  interest  of  the 
government. 
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7.  Conclusion 

The  authors  proposed  that  an  information  environment  can 
be  directed  into  the  technical  specifications  without  changing 
the  procurement  system  and  force  best  value  practices.  This 
hypothesis  is  dependent  on  the  contractor  using  a  QC  plan 
that  minimizes  risk  that  they  do  not  control.  The  use  of  the 
QC  plan,  QA  checklist,  weekly  risk  report,  and  information 
environment  director’s  report,  all  of  which  are  documented 
by  the  contractors,  has  provided  MEDCOM  with  an  accurate 
performance  history  of  construction  projects  on  a  weekly 
basis.  Preliminary  results  indicate  that  the  more  efficient 
environment  has  minimized  nonperformance  within  MED¬ 
COM  and  maximized  the  profit  of  the  contractors  (Welker 
[19]). 
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